Motion deblurring of faces
نویسندگان
چکیده
Face analysis is a core part of computer vision, in which remarkable progress has been observed in the past decades. Current methods achieve recognition and tracking with invariance to fundamental modes of variation such as illumination, 3D pose, expressions. Notwithstanding, a much less standing mode of variation is motion deblurring, which however presents substantial challenges in face analysis. Recent approaches either make oversimplifying assumptions, e.g. in cases of joint optimization with other tasks, or fail to preserve the highly structured shape/identity information. Therefore, we propose a data-driven method that encourages identity preservation. The proposed model includes two parallel streams (sub-networks): the first deblurs the image, the second implicitly extracts and projects the identity of both the sharp and the blurred image in similar subspaces. We devise a method for creating realistic motion blur by averaging a variable number of frames to train our model. The averaged images originate from a 2MF 2 dataset with 10 million facial frames, which we introduce for the task. Considering deblurring as an intermediate step, we utilize the deblurred outputs to conduct a thorough experimentation on high-level face analysis tasks, i.e. landmark localization and face verification. The experimental evaluation demonstrates the superiority of our method.
منابع مشابه
Direct recognition of motion-blurred faces
The need to recognize motion blurred faces is vital for a wide variety of security applications ranging from maritime surveillance to road traffic policing. While much of the rich theory in the analysis of motion blurred images focuses on restoration of the same, we argue that this is an unnecessary (and expensive) step for face recognition. Instead we adopt a direct approach based on the set-t...
متن کاملRemoving Motion Blur With Space-Time Processing
Although spatial deblurring is relatively well understood by assuming that the blur kernel is shift invariant, motion blur is not so when we attempt to deconvolve on a frame-by-frame basis: this is because, in general, videos include complex, multilayer transitions. Indeed, we face an exceedingly difficult problem in motion deblurring of a single frame when the scene contains motion occlusions....
متن کاملNon-uniform Motion Deblurring for Camera Shakes
This paper presents a novel blind motion deblurring algorithm for dealing with non-uniform motion blurs caused by camera shakes. Conventional motion deblurring algorithms assume the blur can be described by a uniform point spread function (PSF). However, this assumption is typically invalid in practice. We exploit a new representation of motion blurs which models the blur effects of camera shak...
متن کاملAdaptive Motion Detection for Image Deblurring in RTS Controller
An Adaptive method for Image Deblurring is presented here. Processing of image data collected from both surveillance camera and on road traffic control motor vehicle camera is a big issue because often the objects are in motion and sometimes both the objects and camera are not steady. This leads to Blurring of the image and further image processing is not possible due to the degradation of rece...
متن کامل